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ABSTRACT 


Operational  commanders  and  planners  are  challenged  with  maintaining  fleet 
presence  in  many  environments  with  limited  resources.  To  add  to  this  challenge,  there 
are  further  constraints  placed  upon  assets  allocated  to  a  given  operational  commander 
such  as  replenishments  at  sea,  multinational  exercises,  diplomatic  port  visits,  and 
predetermined  in-chop  and  out-chop  dates.  In  the  case  of  the  Combined  Maritime  Force 
(CMF),  which  operates  in  the  FIFTH  FLEET  Area  of  Responsibility,  these  constraints  are 
further  magnified  by  the  fact  that  ships  under  his  or  her  operational  command  are  from  as 
many  as  ten  different  coalition  nations  at  any  given  time.  Eurthermore,  command  of  the 
CME  rotates  between  these  coalition  nations,  increasing  the  propensity  for  inconsistent 
and  sub-optimal  resource  allocation.  This  thesis  develops  a  scheduling  tool.  Coalition 
Resource  Allocation  for  Maritime  Security  (C-RAMS)  that  is  capable  of  quickly 
producing  a  schedule  that  optimizes  a  given  measure  of  effectiveness  for  assets  assigned 
to  the  CME.  This  C-RAMS  tool  accounts  for  logistics  requirements  and  allows  a 
commander  to  set  priorities  within  various  sub-regions,  types  of  assets,  and  specific  time 
periods.  We  illustrate  how  C-RAMS  provides  such  an  optimal  schedule  and  also 
provides  insights  into  interactions  between  different  priorities  and  ship  types,  including 
those  which  may  be  interpolated  for  future  force  configurations,  through  the  use  of 
Visual  Basic  with  an  Excel  2003  user  interface. 
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EXECUTIVE  SUMMARY 


Commanders  must  plan  the  loeations  and  activities  of  several  ships  at  a  time  to 
maintain  presence,  accomplish  specific  missions,  and  maintain  fleet  readiness.  In  the 
current  environment  of  decreasing  asset  availability  and  increasing  reliance  on 
multinational  operations,  these  demands  are  made  even  more  difficult  by  the  need  for 
greater  coordination  and  more  efficient  allocation  of  resources.  This  is  certainly 
important  in  the  FIFTH  FLEET  Area  of  Responsibility,  where  the  Combined  Maritime 
Eorce  (CME)  is  responsible  for  an  area  in  excess  of  2.5  million  square  miles.  Assigned  to 
the  CMF  are  anywhere  from  eight  to  twelve  vessels  typically  belonging  to  the  United 
States,  the  United  Kingdom,  Erance,  Italy,  Pakistan,  Australia,  The  Netherlands,  and 
Bahrain,  with  command  being  rotated  every  three  months  within  this  pool  of  nations. 

Although  there  are  many  complex  decisions  requiring  the  consideration  of 
multiple  factors  in  scheduling  the  assets  of  the  CME,  there  exists  no  uniform  approach  to 
planning  as  command  is  passed  from  one  country  to  the  next.  Without  such  uniformity, 
the  opportunity  for  less  than  desirable  scheduling  and  underutilization  of  resources  is 
significant. 

This  study  develops  the  Coalition  Resource  Allocation  for  Maritime  Security  (C- 
RAMS)  decision  support  tool  for  the  scheduling  of  maritime  assets,  which  is  flexible 
enough  to  account  for  a  wide  range  of  daily  scheduling  constraints  and  mission  priorities 
as  set  by  a  given  commander.  Eurthermore,  the  output  of  the  resulting  scheduling  tool 
provides  useful  information  in  the  near  term  while  also  creating  a  baseline  of  study  for 
future  operations  with  the  employment  of  augmenting  technologies  such  as  maritime 
Unmanned  Aerial  Vehicles.  To  maximize  system  compatibility,  C-RAMS  is  written  in 
Visual  Basic  with  an  Excel  user  interface. 

In  this  study,  we  use  a  network  model  overlaid  on  a  map  of  the  EIETH  EEEET 
AOR,  where  each  sea  zone  is  a  node  in  which  a  ship  can  produce  a  reward  for  its 
presence.  In  this  geographic  network,  transit  zones  between  sea  zones  are  vertices  that  do 
not  incur  a  reward,  but  may  be  scheduled  to  permit  movement  between  sea  zones  to 

xiii 


increase  a  ship’s  reward  or  to  move  toward  a  future  obligation  sueh  as  a  port  visit  or  a 
replenishment-at-sea  (RAS).  We  consider  four  sea  zones  representing  the  Red  Sea,  the 
Arabian  Sea,  the  Western  Indian  Ocean,  and  the  Arabian  Gulf,  respeetively.  Also 
represented  in  this  geographie  network  are  nodes  adjaeent  to  the  four  sea  zones  whieh 
aeeount  for  pre-seheduled  port  visits,  RASs,  in-ehopping  into,  and  out-ehopping  from  the 
eontrol  of  the  CMF  Commander.  This  is  then  used  to  plan  for  5  to  30  days  at  a  time, 
using  a  network  representation  of  possible  ship  positions  and  states. 

With  the  geographic  network  and  the  first  day’s  eonfiguration  of  ship  loeations, 
we  build  a  time-expanded  eonfiguration  network.  A  column  of  configuration  nodes  is 
ereated  in  eaeh  following  day  based  solely  upon  eonfigurations  whieh  eontain  only  ship 
positions  and  activities  that  are  geographieally  adjaeent  (and  therefore  feasibly  reachable) 
in  one  time  step  for  eaeh  ship.  Eaeh  resulting  state  is  then  added  to  a  state  veetor  whieh 
eonsists  of  eaeh  possible  eonfiguration  for  the  given  time  step.  Ares  represent  feasible 
transitions  between  state  veetors  in  suceessive  days.  This  time-expanded  eonfiguration 
network  is  then  implieitly  built  and  solved  utilizing  a  deterministie  dynamie  program  to 
find  a  longest  (i.e.  maximum  reward)  path. 

The  deeision  support  tool  can  be  shared  by  US  and  eoalition  naval  personnel  for 
the  seheduling  of  MSO  ships  in  the  FIFTH  FFEET  AOR.  The  Coalition  Resouree 
Alloeation  for  Maritime  Seeurity  deeision  support  tool  ineorporates  a  given  set  of  pre¬ 
existing  mission  eommitments  as  parameters  and  provides  an  optimum  employment 
strategy  based  on  eommander’s  intent  and  priorities.  The  output  is  a  sehedule  that  is 
feasible,  and  eompatible  with  existing  reporting  requirements. 
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I.  INTRODUCTION 


A,  BACKGROUND 

This  study  seeks  to  develop  a  deeision  support  tool  for  the  seheduling  of  maritime 
assets,  particularly  in  the  FIFTH  FLEET  Area  of  Responsibility,  which  is  flexible  enough 
to  account  for  a  wide  range  of  scheduling  constraints  and  varying  degrees  of  priorities  as 
set  by  a  given  commander.  Eurthermore,  the  output  of  the  resulting  scheduling  tool  may 
provide  useful  information  in  the  near  term  while  also  creating  a  baseline  of  study  for 
future  operations  with  the  employment  of  augmenting  technologies  such  as  maritime 
Unmanned  Aerial  Vehicles  (UAVs).  Einally,  such  a  tool  should  be  compatible  with 
existing  computer  operating  systems  and  software  used  by  all  interested  nations. 

1.  Maritime  Security  Operations 

In  recent  years,  the  United  States  Navy  has  dramatically  increased  the  number  of 
Maritime  Security  Operations  (MSO)  it  performs  in  support  of  the  Global  War  on  Terror 
(GWOT)  and  various  international  agreements.  The  vast  majority  of  these  missions 
occur  in  the  EIETH  EEEET  Area  of  Responsibility  (AOR)  in  conjunction  with  coalition 
forces  under  the  auspices  of  the  Combined  Maritime  Eorce  (CME).  The  CME  is 
comprised  of  Combined  Task  Eorces  (CTEs)  150,  152,  and  158,  each  with  a  specific  sub- 
AOR,  and  its  own  set  of  specific  missions,  geography,  and  challenges. 

The  scope  of  the  challenges  facing  the  CMF  cannot  be  fully  appreciated  without 

first  understanding  the  purpose  of  MSO.  The  official  missions,  as  published  by 

Commander,  Combined  Maritime  forces  (CUSNC,  2008),  are  as  follows: 

Coalition  and  U.S.  forces  conduct  MSO  to  help  set  the  conditions  for 
security  and  stability  in  the  maritime  environment,  as  well  as  complement 
the  counter-terrorism  and  security  efforts  of  regional  nations. 

MSO  seek  to  disrupt  violent  extremists’  use  of  the  maritime  environment 
as  a  venue  for  attack  or  to  transport  personnel,  weapons  or  other  material. 
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Coalition  maritime  forces  conduct  MSO  in  international  waters  in  the 
Arabian  Gulf,  Arabian  Sea,  Gulf  of  Oman,  Gulf  of  Aden,  Indian  Ocean 
and  Red  Sea. 

MSO  includes  a  full  range  of  activities  from  assisting  mariners  in  distress 
to  Visit,  Board,  Search  and  Seizure  operations  to  engaging  regional  and 
coalition  navies. 

More  specifically,  CTFs  150  and  152  share  a  common  mission  statement  which 
encapsulates  the  broader  vision  of  the  CMF  Commander;  “To  help  set  the  conditions  for 
security  and  stability  in  the  maritime  environment  as  well  as  complement  the  counter¬ 
terrorism  and  security  efforts  of  regional  nations.  These  operations  deny  international 
terrorists  use  of  the  maritime  environment  as  a  venue  for  attack  or  to  transport  personnel, 
weapons  or  other  material”  (CUSNC,  2008).  The  difference  between  these  two  CTFs 
being  that  150  must  cover  the  expanse  of  the  Gulf  of  Aden,  Gulf  of  Oman,  the  Arabian 
Sea,  Red  Sea  and  the  Northwestern  Indian  Ocean,  whereas  CTF  152  is  responsible  for  the 
South  and  Central  Arabian  Gulf.  The  Northern  Arabian  Gulf  AOR  belongs  to  CTF  158, 
which  in  addition  to  the  common  MSO  mission  is  responsible  for,  “maintaining  security 
in  and  around  both  the  A1  Basrah  and  Khawr  A1  Amaya  Oil  Terminals  (ABOT  and 
KAAOT,  respectively),  in  support  of  U.N.  Security  Council  Resolution  1723.  This 
resolution  charges  the  multinational  force  with  the  responsibility  and  authority  to 
maintain  security  and  stability  in  the  Iraqi  territorial  waters  and  also  supports  the  Iraqi 
government’s  request  for  security  supporf’  (CUSNC,  2008). 
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Figure  1 .  FIFTH  FLEET  AOR. 


The  total  AOR  for  the  CME  is  in  exeess  of  2.5  million  square  miles  and  borders 
21  eountries  spanning  two  eontinents  and  countless  cultures.  Assigned  to  the  CME  are 
anywhere  from  eight  to  twelve  vessels  typically  belonging  to  the  United  States,  the 
United  Kingdom,  Erance,  Italy,  Pakistan,  Australia,  The  Netherlands,  and  Bahrain. 
Ranging  in  size  and  capability,  most  assets  assigned  to  one  of  the  MSO  CTEs  are  capable 
of  employing  helicopters  and  at  least  two  boarding  teams.  Currently  the  largest  platform 
to  be  assigned  to  MSO  is  a  390-man  Ticonderoga-class  cruiser  (CG)  of  the  U.S.  Navy. 
When  fully  equipped,  it  carries  two  Eight  Airborne  Multi  Purpose  System  (EAMPS)  SH- 
60B  Helicopters,  two  small  boats,  25mm  machine  gun,  and  various  other  crew-served 
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weapons.  Conversely,  the  smallest  platform  typically  assigned  is  the  U.S.  Coast  Guard’s 
1 10-foot  Cutter  (USCGC).  Also  sporting  a  25mm  machine  gun,  the  cutters  carry  two  50- 
caliber  machine  guns,  miscellaneous  small  arms  and  a  crew  of  16. 


Figure  2.  USS  CHANCELLORSVILLE  (CG  62). 


Eigure  3 .  USCGC  MUSTANG. 

All  coalition  warships,  regardless  of  nationality,  appear  on  the  spectrum  of 
capabilities  and  armament  between  these  two  examples. 

Given  the  vast  area  of  the  waters  of  the  FIETH  FLEET  AOR,  the  relatively  small 
number  of  ships  assigned  to  the  CME,  and  the  multiple  taskings  of  each  of  those  ships,  a 
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tool  for  optimally  scheduling  these  assets  would  aid  the  CMF  Commander  in  planning. 
Ideally,  the  CMF  Commander  would  be  able  to  assign  priorities  to  speeifie  areas  and 
missions  on  a  given  time  horizon — notionally  two  weeks — based  on  intelligence, 
seasonal  traffie  patterns,  historieal  suceesses  and  failures,  and  task  saturation.  Given  this 
data  and  asset  availability,  a  desirable  sehedule  is  one  that  optimizes  asset  alloeation  to 
missions  over  the  given  time  horizon.  Onee  an  optimal  schedule  is  attained,  the  resulting 
data  serves  as  a  baseline  for  measuring  the  effieacy  of  the  given  assets  upon  whieh  we 
perform  a  eost-benefit  analysis  of  the  employment  of  maritime  Unmanned  Aerial 
Vehieles  (UAVs).  Sueh  analyses  ean  assist  in  the  deeision  of  whieh  and  how  many 
UAVs  to  proeure  and  deploy  with  U.S.  maritime  assets. 

2.  UAV  Employment 

Not  yet  a  mainstay  in  MSO,  UAVs  have  started  to  be  deployed  to  the  FIFTH 
FLEET  AOR  onboard  U.S.  Navy  DDGs  for  information,  surveillanee,  and 
reeonnaissanee  (ISR)  support  of  eurrent  operations.  Eirst  deployed  onboard  USS 
OSCAR  AUSTIN  (DDG  79)  in  November  2007,  Boeing’s  Sean  Eagle  reached  a 
milestone  in  April  2008  when  it  aehieved  its  1000*’^  shipboard  reeovery  (Aviation.eom, 
2008).  While  the  future  of  sueh  UAVs  onboard  MSO  platforms  remains  undefined,  the 
U.S.  Navy  has  eommitted  itself  to  their  use  and  eould  be  well  served  by  a  tool  whieh 
would  assist  in  the  determination  of  an  appropriate  proeurement  strategy. 

B,  OBJECTIVES  AND  BENEFITS  OF  STUDY 

We  develop  a  deeision  support  tool  that  ineorporates  software  that  can  be 
implemented  and  shared  by  U.S.  and  coalition  naval  personnel  for  the  seheduling  of 
MSO  ships  in  any  given  AOR.  Additionally,  the  data  it  produees  is  useful  for  performing 
a  study  in  the  proeurement  and  deployment  of  UAVs  by  the  U.S.  Navy. 

The  seope  of  this  thesis  is  to  develop  a  ship  seheduling  tool  that  will  ineorporate  a 
given  set  of  pre-existing  mission  eommitments  as  parameters  and  provide  an  optimum 
employment  strategy  based  on  commander’s  intent  and  priorities.  The  tool  utilizes 
eommon  software  such  as  Excel  and  Visual  Basie  so  that  it  may  be  easily  shared  within 
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the  DoD  and  among  coalition  partners.  The  output  is  a  schedule  that  is  feasible,  easy  to 
read,  and  compatible  with  existing  reporting  requirements. 
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II.  DEVELOPMENTS  IN  SCHEDULING  TOOLS,  UAVS,  AND 

LITERATURE  REVIEW 

A,  MARITIME  SCHEDULING  TOOLS 

Many  scheduling  tools  have  been  developed  for  the  purpose  of  optimally 
alloeating  assets  for  both  military  and  non-military  applieations.  Of  partieular  note,  tools 
that  eould  be  applied  to  the  alloeation  of  MSO  assets  are  the  Central-West  Afriea 
Resouree  and  Mission  Alloeation  model  (CARMA)  (Spitz,  2007)  and  the  Navy  Mission 
Planner  (NMP)  (Dugan,  2007).  Both  take  into  aeeount  the  relative  value  of  specifie 
missions  and/or  loeations  from  the  eommander’s  perspeetive,  utilize  integer 
programming,  and  deliver  an  optimal  allocation  for  a  given  time  horizon.  But  to  the 
author’s  knowledge,  there  exists  no  maritime  asset  seheduling  tool  that  ineorporates  the 
same  relative  value  eoneept  while  incorporating  logistical  support  constraints  as  input 
parameters.  In  a  praetieal  sense,  ignoring  these  eonstraints  or  simply  assuming  that 
logistie  support  will  be  taken  eare  of  ean  produee  a  model  that  delivers  an  “optimal” 
solution  whieh  is  ultimately  infeasible  (i.e.,  logistieally  unsupportable)  in  the  real  world. 

While  many  other  seheduling  and  logisties  tools  have  been  developed  for  a 
myriad  of  applieations  (Berner,  2007;  Chng,  2007;  DeGrange,  2004;  Lape,  1993;  & 
Lenhardt,  2001,  to  name  a  few),  to  the  author’s  knowledge  none  exist  that  incorporate  an 
adequately  flexible  rewards  funetion,  the  ability  to  input  pre-assigned  port  visits,  in-ehop 
and  out-ehop  times,  and  (most  importantly)  underway  replenishment  sehedules  in  a  tool 
that  would  be  eompatible  with  existing  U.S.  and  eoalition  eomputer  operating  systems 
and  software. 

1,  Central-West  Africa  Resource  and  Mission  Allocation  Model 

The  Central-West  Afriea  Resource  and  Mission  Alloeation  model  bridges  the 
strategic  and  operational  levels  of  planning  to  maximize  presenee  or  effectiveness  of  a  set 
of  maritime  assets  in  a  given  AOR.  This  mixed-integer  program  is  eonstrained  by  a 
budget,  port  eosts,  multiple  penalty  funetions,  and  fuel.  Relying  on  the  Global  Fleet 
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Stationing  (GFS)  concept,  the  CARMA  model  seeks  to  provide  an  optimal  logisties- 
based  strategy  for  deploying  U.S.  assets  to  engage  in  Theater  Security  and  Cooperation 
(TSC)  missions  with  the  nations  on  the  Gulf  of  Guinea  (GOG).  Designed  to  improve  on 
solving  the  standard  Vehicle  Routing  Problem,  CARMA  allows  for  multiple  layers  of 
reward  funetions  to  optimize  prioritized  (and  sometimes  eonflieting)  mission  objectives 
(Spitz,  2007). 

While  CARMA  has  been  implemented  as  a  strategie-to-operational  tool  for 
planning  resouree  alloeation  in  the  GOG,  there  remains  the  potential  to  expand  this 
eoneept  to  tasking  from  a  lower  level  commander  on  a  shorter  time  horizon  than  that 
utilized  in  the  model,  providing  an  opportunity  for  ships  to  be  further  alloeated  so  support 
multinational  operations.  In  its  current  form,  it  provides  for  planning  deployment 
sehedules  for  the  entire  speetrum  of  U.S.  assets  to  be  deployed  to  the  GOG,  and  is 
therefore  inherently  limited  (for  the  sake  of  multi-national  MSO  asset  alloeation)  by  its 
eonneetion  to  U.S.  Navy  budgeting  and  its  being  geared  towards  platforms  designed  for 
eompatibility  with  GFS.  Furthermore,  it  relies  on  GAMS/CPLEX  (Spitz,  2007)  for 
eomputing  solutions — software  that  is  unlikely  to  be  at  the  disposal  of  afloat  U.S.  or 
coalition  commanders. 

2,  Navy  Mission  Planner 

The  Navy  Mission  Planner  optimizes  multiple  sehedules  for  assets  assigned  to  a 
speeific  AOR  based  on  their  possible  movements,  specifie  ship  eapabilities,  and 
deconflicting  incompatible  missions.  NMP  allows  for  a  theater  eommander  to  set  reward 
values  based  on  mission  priorities  for  a  given  time  horizon,  and  finding  an  optimal 
sehedule  for  a  set  of  ships  over  that  time  period.  NMP,  however,  does  not  aeeount  for 
logisties  requirements  for  the  ships  assigned  to  the  given  AOR.  Additionally,  it  is 
designed  to  aeeommodate  a  set  of  possible  warfare  eapabilities  for  a  given  array  of  U.S. 
ships,  some  of  whieh  may  be  elassified.  These  limitations  therefore  do  not  lend  NMP 
well  for  applieation  toward  multinational  resouree  alloeation  for  a  more  narrow  and 
unelassified  set  of  missions.  Although  robust  and  quite  flexible  in  allowing  the 
assignment  of  priorities  for  a  eommander,  it  also  falls  short  in  its  inability  to  ineorporate 


8 


logistics  requirements.  Based  in  Exeel  and  Visual  Basie,  it  eould  be  deployed  for 
immediate  use  within  the  fleet,  but  will  still  require  some  modifieation  to  ensure  its 
solutions  are  truly  feasible  and  do  not  eonfliot  with  the  eonstraints  imposed  by  the 
availability  of  logisties  assets  (Dugan,  2007). 

3.  Combat  Logistics  Force  Planning  Tool 

For  the  speeifie  requirements  assoeiated  with  seheduling  Combat  Logisties  Foree 
(CLF)  assets,  the  CLF  Planning  Model  developed  by  (Borden,  2001)  provides  an  optimal 
solution  to  the  total  number  of  short-ton  days  a  given  eombat  fleet  experienees  levels 
below  a  given  safety  stoek.  Most  reeently,  this  model  has  provided  a  data  foundation  for 
optimally  moving  shuttle  ships  within  a  given  network  between  eustomers,  waypoints, 
and  resupply  ports  utilizing  a  Floyd-Warshall  shortest  path  algorithm  (Morse,  2008). 

Of  partieular  interest  in  this  version  of  the  CLF  Planning  Model  is  the  utilization 
of  Floyd-Warshall  in  optimizing  the  movement  of  a  given  set  of  assets,  an  approaeh  that 
eould  prove  useful  in  the  development  of  an  MSO  seheduling  tool.  Furthermore,  the 
results  from  this  tool  may  provide  reasonable  parameters  for  predetermined 
replenishments-at-sea  (RAS)  around  whieh  our  seheduling  tool  may  optimize  asset 
alloeation. 

B,  MARITIME  UAV  DEVELOPMENT  AND  EMPLOYMENT 

In  1999,  the  U.S.  Navy’s  Unmanned  Aerial  Vehiele  Program  Manager  published 
the  Performanee  Speeifieation  for  the  Vertieal  Takeoff  and  Landing  Taetieal  Unmanned 
Aerial  Vehiele  (VTUAV).  Mandated  to  be  deployable  on  CG  47  and  DDG  51  elass 
ships,  the  VTUAV  shall  be  eapable  of  at  least  12  hours  of  eontinuous,  sustained 
operations  in  a  24  hour  period.  Furthermore,  its  shipboard  footprint  shall  not  exeeed  that 
of  SH-60B  helieopters  and  the  system  shall  be  eompatible  with  existing  shipboard 
eonfigurations.  Under  these  eonditions,  the  VTUAV  would  be  deployable  immediately 
upon  delivery  to  the  Navy,  aeting  as  an  over  the  horizon,  high-resolution  sensor  eapable 
of  remaining  on  station  two  to  four  times  longer  than  existing  LAMPS  assets  without  the 
limitations  assoeiated  with  manned  aireraft.  This  eapability  eould  aet  as  a  foree 
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multiplier  for  MSO  missions,  reducing  the  distances  traveled  by  ships  to  positively 
identify  vessels  of  interest  and  improving  situational  awareness  for  commanders 
(VTUAV  Spec  Development  Team,  1999). 

An  existing  alternative,  the  fixed-wing  Scan  Eagle,  has  already  been  proven  in  a 
maritime  environment.  Deployed  in  November  2007,  onboard  USS  OSCAR  AUSTIN 
(DDG  79)  in  support  of  MSO  in  the  FIFTH  FFEET  AOR,  Scan  Eagle  has  an  operational 
endurance  in  excess  of  20  hours  and  a  logistics  footprint  significantly  smaller  than  that 
mandated  for  the  VTUAV  program.  In  June  2008,  the  U.S.  Navy  awarded  Boeing  a  $65 
million  contract  for  future  support  with  the  Scan  Eagle  UAV  system,  having  proven  itself 
as  viable  for  ISR  missions  onboard  15  U.S.  Navy  ships  to  date  (Commeagle,  2008). 

C.  MARITIME  SECURITY  OPERATIONS  IN  NETWORK-CENTRIC 

WARFARE 

In  Grivell  and  Fewell  (2008),  a  Bayesian  network  utilization  model  was  used  to 
demonstrate  the  value  of  intelligence  when  MSO  assets  were  employed  using  a 
prioritized  queue.  In  this  model,  significant  changes  in  the  efficacy  of  assigned  forces  are 
evident  based  on  changes  in  a  given  concept  of  operations  (CONOPS).  In  cases  where 
the  CONOPS  permit  an  aggressive  posture— where  a  boarding  may  be  pre-empted  to 
allow  teams  to  switch  to  a  higher-priority  target  upon  discovery— or  in  cases  where 
friendly  or  neutral  vessels  are  in  the  majority,  the  model  reveals  an  advantage  to  utilizing 
a  Network  Centric  Warfare  (NCW)  approach.  Defined  by  the  authors  as,  “the  conduct  of 
military  operations  using  networked  information  systems  to  generate  a  flexible  and  agile 
military  force... independent  of  individual  elements,  and  in  which  the  focus  of  the 
warfighter  is  broadened  away  from... unit  or  platform  concerns  to  give  primacy  to 
the... task  group  or  coalition,”  the  NCW  advantage,  however,  was  tempered  by  a 
diminishing  returns  effect.  For  example,  if  a  commander’s  database  of  known  vessels  of 
interest  in  a  given  was  only  half  populated,  it  was  found  to  be  two-thirds  as  valuable  as  a 
complete  database.  What  remained  constant,  while  at  varying  degrees,  was  the  value  of 
improved  (or  more  accurate)  information. 
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With  information  as  the  central  force  multiplier  in  NCW,  expanding  the  role  of 
UAVs  in  the  execution  of  MSO  would  appear  to  be  a  cost-effective  means  of  increasing 
the  value  of  assets  to  be  assigned  for  these  missions.  Furthermore,  the  results  of  the  study 
suggest  that  the  increase  of  employing  assets  for  the  sake  of  expanding  battlespace 
awareness  will  result  in  a  diminishing  returns  effect.  We  will  allow  for  similar 
diminishing  “rewards”  in  our  decision  support  tool. 

D,  LITERATURE  REVIEW  CONCLUSIONS 

In  light  of  the  shortcomings  and  strengths  of  the  many  tools  already  in  existence, 
it  is  the  author’s  belief  that  a  scheduling  tool  for  the  effective  allocation  of  coalition  MSO 
assets  should  be  based  in  Excel  and  Visual  Basic.  This  tool  should  also  allow  for  input 
parameters  such  as  predetermined  logistics  requirements  and  port  visits,  and  give 
commanders  an  optimal  solution  based  on  his  or  her  stated  priorities,  intelligence, 
seasonal  maritime  traffic  patterns,  ship  capabilities,  target  density,  and  region-specific 
functions  that  can  provide  for  diminishing  returns  or  a  multiplicative  effect  with  the 
introduction  of  additional  assets. 
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III.  OPTIMAL  SCHEDULING 


A,  SCHEDULING  MODEL  DEVELOPMENT 

This  chapter  introduces  a  network  optimization  model  for  building  a  schedule 
based  on  reward  criteria  set  by  the  CTF  Commander.  In  this  study,  we  are  concerned 
with  optimizing  the  daily  loeations  and  activities  of  a  group  of  ships  over  a  finite  time 
horizon.  Eaeh  ship  on  each  day  has  a  location  (e.g.  “Arabian  Gulf’)  and  an  activity,  such 
as  a  port  visit  or  RAS.  We  use  a  network  model  of  the  FIFTH  FLEET  AOR  where  each 
vertex  represents  a  sea  zone  and  an  activity.  Each  edge  in  this  network  represents  a 
transition  from  one  of  these  pairs  that  can  occur  in  one  day.  Certain  locations,  such  as 
choke  points,  allow  only  one  possible  aetivity — transit  between  zones — to  oecur,  and 
therefore  have  only  one  vertex  associated  with  them.  All  four  sea  zones,  however,  allow 
for  pre-seheduled  port  visits,  RASs,  in-chopping  into,  and  out-chopping  from  the  control 
of  the  CME  Commander  (Eigure  4). 


I  N 
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Figure  4.  Geographie  Network. 
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The  time  ships  spend  in  the  sea  zone  vertices  conducting  MSO  is  what  we  seek  to 
maximize.  In  this  geographic  network  illustrated  in  Figure  4,  transit  zones  between  sea 
zones  are  nodes  that  do  not  incur  a  reward,  but  may  be  scheduled  to  permit  movement 
between  sea  zones  to  increase  a  ship’s  reward  or  to  move  toward  a  future  obligation  such 
as  a  port  visit  or  a  RAS.  We  have  in  this  case  four  sea  zones  representing  the  Red  Sea 
(vertex  1),  the  Arabian  Sea  (vertex  2),  the  Western  Indian  Ocean  (vertex  3),  and  the 
Arabian  Gulf  (vertex  4)  respectively.  Adjacent  to  each  sea  zone  in  which  MSO  may  be 
conducted,  there  are  activity  vertices.  Figure  5  illustrates  these  adjacencies  for  sea  zone 
2,  with  vertices  50,  60,  and  70  representing  transit  choke  points,  12  representing  a  RAS, 
22  a  port  visit,  32  in-chopping  to  the  AOR,  and  42  as  out-chopping  from  the  AOR. 


Figure  5.  Adjacencies  to  Zone  2  in  Geographic  Network. 

The  desired  outcome  of  the  model  we  develop  will  be  a  schedule  that  maximizes 
the  aggregate  reward  of  all  ships  performing  MSO  missions  on  a  notional  timeline  of 
fifteen  days,  while  conforming  to  the  physical  and  planning  constraints  represented  in  the 
geographic  network. 
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1. 


Schedule  Optimization  Tools 


A  common  hindrance  to  the  deployment  of  seheduling  tools  developed  in  an 
aeademie  environment  is  the  software  used  to  solve  the  optimization  models.  Most  U.S. 
Navy  activities  do  not  possess  software  eommon  to  aeademia  sueh  as  GAMS  or 
MATLAB.  Additionally,  Navy  and  Marine  Corps  Intranet  (NMCI)  may  not  even  support 
eommon  eommereial  off-the-shelf  (COTS)  software  paekages  that  eould  run  linear  or 
nonlinear  programming  solvers.  Almost  universal,  however,  to  Department  of  Defense 
and  eoalition  partners  is  Mierosoft  Offiee,  whieh  ineludes  Exeel  and  Visual  Basie  (VBA) 
for  applieations. 

2,  Acyclic  Network  Longest-Path  Approach 

To  achieve  an  optimal  schedule,  we  construct  an  acyclic  time-expanded 
configuration  network  as  depicted  in  Figure  5.  In  this  network,  nodes  represent  feasible 
configurations  of  assets  to  be  scheduled  by  the  tool.  A  configuration  is  defined  as  a  set  of 
ships  on  a  given  day,  each  occupying  any  one  of  the  twenty  three  location  nodes  in  the 
geographic  network.  Given  scheduling  constraints  and  geographic  adjacency  limitations 
within  the  geographic  network,  not  all  configurations  need  to  be  considered  for  inclusion 
to  the  configuration  network.  Each  node  in  the  configuration  network  that  is  selected  by 
a  simple  reaching  algorithm  adds  its  reward  value  to  the  total  value  of  the  longest  path.  A 
reward  value  is  simply  a  number  assigned  to  a  given  configuration  based  on  its 
predetermined  importance  to  a  commander  by  way  of  the  force  presence  it  may  provide 
in  a  theater.  The  resulting  path  would  then  represent  the  best  possible  feasible  schedule 
that  conforms  to  a  commander’s  predetermined  set  of  priorities  based  on  intelligence, 
seasonal  traffic  patterns,  historical  successes  and  failures,  task  saturation,  and  any  other 
quality  declared  important  by  the  commander. 

To  build  the  configuration  network,  we  take  the  first  time  step’s  configuration  of 

ship  locations  as  a  given.  As  depicted  in  Figure  6,  a  column  of  configuration  nodes  is 

created  in  each  following  day  based  solely  upon  configurations  which  contain  only  ship 

positions  that  are  geographically  adjacent  (and  therefore  feasibly  reachable)  in  one  time 

step  for  each  ship.  We  define  these  feasible  configurations  as  a  state.  Each  resulting 
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state  is  then  added  to  a  state  veetor  whieh  eonsists  of  each  possible  configuration  for  the 
given  time  step.  To  produce  arcs  between  nodes  in  each  column  vector,  only  feasibly 
reachable  configurations  are  added  to  the  forward  star  of  each  previous  day’s 
configuration  node  and  given  a  cost  that  represents  a  predetermined  reward  value 
determined  by  the  commander. 


Figure  6.  Time -Expanded  Configuration  Network. 


We  build  the  configuration  network  one  day  at  a  time  and  optimize  the  path  as  we 
build  the  network  using  dynamic  programming,  as  explained  in  Abuja,  Magnanti,  and 
Orlin  (1993).  The  next  section  provides  details  about  the  formulation. 

B,  FORMULATION 

This  section  formulates  the  ship  scheduling  problem  as  a  longest-path  problem  in 
the  configuration  network.  The  Coalition  Resource  Allocation  for  Maritime  Security  (C- 
RAMS)  scheduling  tool  utilizes  a  longest-path  maximum-cost  network  flow  linear 
program.  C-RAMS  seeks  to  maximize  the  reward  value  for  the  cumulative 
configurations  (ship  locations)  in  the  geographic  network  for  a  given  AOR. 
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Indices: 


/ 

s 

t 

n 


Locations  in  the  geographic  network.  /  =  1,  2,  3,  L 
Ships  to  be  scheduled,  s  =  1,2,  3,  ....  S 
Time  steps  (e.g.,  day).  t=  1,  2,  3,  ....  T 

Configuration,  where  n  represents  a  time  period  t  and  an  S- 
dimension  vector  with  the  component  being  the  location  of  ship 
5  in  time  period  t. 

'h 

h 


n  =< 


,t> 


Sets: 

Nt  Subset  of  all  possible  configurations  in  time  period  t  determined  by 

Network  Building  Algorithm,  see  below. 

N  Set  of  possible  configurations.  N=  yj  tNt  over  all  t 

F„  Forward  star  of  configuration  n  determined  by  Network  Building 

Algorithm,  see  below. 

B„  Reverse  star  of  configuration  n  determined  by  Network  Building 

Algorithm,  see  below. 

Data: 

r„  Reward  assigned  for  executing  configuration  n. 

Variables: 


Formulation: 


1  if  execution  of  configuration  n  ’  follows  execution  of  n. 
0  Otherwise. 


max  V  r  ,A„  , 

n  n,n 

nE.N,n'E.F^ 


s.t. 


n'eB^  n'e.F„ 

neNi,n'EF„ 
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Network  Building  Algorithm  for  Computing  TV,,  F„,  and  Bn 


Inputs: 


T  vectors  of  pre-set  ship  obligations 


2,, 


,t=\,2,  where 


4 ,  is  the  predetermined  location  of  ship  s  for  time  period  t.  If  no  commitment 


0. 


Outputs:  Subset  of  all  possible  configurations  within  configuration  network  in 

•  time  period  t  (TV,,) 

•  Forward  star  of  configuration  n  {F„) 

•  Reverse  star  of  configuration  n  (Bn) 


Note:  In  this  algorithm,  by  feasibility  we  mean  a  condition  in  which  it  is 
physically  possible  for  a  ship  or  a  set  of  ships  to  move  from  one  configuration  to 
another. 


Algorithm: 

1 .  Create  availability  sets  for  each  time  period  and  ship  as  follows: 

a.  For  every  5  =1,2,... S',  set 

4,, 

b.  For  T  =  2  to  r 

For  5  =  1  to  S 

Construct  As_ ,  as  follows. 

If  ft  >  0,  then  set  Asj  =  {h.t}  • 

Else,  set^^,,=  {1,  2,  ...,L} 

c.  For  T  =  2  to  r 

For  5  =  1  to  S 
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Reduce  the  size  of  As,,  by  preprocessing.  This  is  done  by 
recursively  scanning  forward  and  backward  from  each^f^.^  and  eliminating 
all  configurations  with  one  or  more  infeasible  ship  movements. 

2.  Then  enumerate 

for  each  t=2...T 

use  As,t,  s=\,.. .S,  enumerate  possible  configurations  to  create  N,. 

3.  Create  forward  and  backward  star  from  Nt. 

a.  For  each  configuration  in  t,  check  feasibility  of  executing  configuration 
change  to  each  configuration  in  t+\.  If  feasible,  add  to  F„. 

b.  For  each  configuration  in  t,  check  feasibility  of  executing  configuration 
change  to  each  configuration  in  t-1 .  If  feasible,  add  to  Bn. 

C.  REWARDS  DETERMINATION  AND  ASSIGNMENT 


To  produce  the  reward  data  necessary  for  building  the  acyclic  network,  we  define 
a  function/  where/is  specified  by  the  user  of  the  scheduling  tool  based  on  intelligence, 
commander’s  intent,  specific  ship  capabilities,  seasonal  norms,  etc.  We  define  the  reward 
of  configuration  n  as 


k 

k 


rn=fi 


A) 


In  this  thesis,  we  set  /  as  the  summation  of  predetermined  reward  values  per  ship 
s  in  location  /  in  time  period  t  multiplied  by  a  function  that  allows  a  commander  to  model 
diminishing  returns  for  adding  ships  to  a  given  region  as  well  as  providing  an  additional 
bonus  for  not  leaving  any  zones  uncovered.  In  this  case,  we  define  r^s,,  as  the  reward  for 
having  ship  s  in  location  /  in  time  period  t. 
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1. 


Reward  Update  Module 


To  provide  a  sufficiently  flexible  input  module  for  assigning  rewards,  a  Reward 
Update  Module  (RUM)  was  built  within  C-RAMS.  Each  category  of  ships  assignable  is 
given  a  baseline  reward  value  relative  to  other  ship  types  on  a  given  day.  Then,  each 
ship’s  relative  value  for  being  assigned  in  each  zone  is  selected.  The  resulting  value  will 
provide  that  day’s  reward  value  for  a  given  ship  in  a  given  zone.  A  base  case  can  be 
selected  from  which  each  day  in  the  given  time  horizon  may  be  more  quickly  adjusted. 
For  the  sake  of  this  study,  ship  type  A  is  a  U.S.  Navy  Cruiser  or  flight  IIA  DDG,  type  B 
is  a  U.S.  Navy  Flight  I  DDG,  Type  C  is  a  U.S.  Navy  FFG  or  coalition  warship  without 
helicopters.  Type  D  is  a  U.S.  Navy  FFG  or  coalition  warship  with  helicopters.  Type  E  is  a 
U.S.  Coast  Guard  Cutter  or  U.S.  Navy  PC,  and  Type  F  is  reserved  for  another  ship  class. 
In  this  case  we  will  call  Type  F  U.S.  Navy  DDG  Flight  I  with  UAVs  in  order  to  study  the 
effect  on  scheduling  employing  UAVs  to  these  ships  may  have.  This  base  case  appears 
as  seen  in  Figure  7,  in  which  the  column  of  slide  bars  on  the  left  adjusts  the  baseline 
value  of  each  ship  type  relative  to  each  other  and  the  array  of  slide  bars  on  the  right  adjust 
the  relative  value  of  each  ship  type  within  each  zone.  The  values  highlighted  in  green 
represent  the  product  of  the  zone  and  ship  values  to  be  called  by  the  reward  calculation 
subroutine. 


Figure  7.  Ship  Type  and  Zone  Reward  Assignment  in  RUM. 
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Next,  the  diminishing  (or  increasing)  returns  values  are  set  for  each  zone.  To  set 
these  values,  we  define  a  Marginal  Rewards  Multiplier  (MRM)  X  as 


,(1.5) 


X  = 


2x 


where  x  is  a  sequence  number  assigned  to  a  each  ship  within  a  given  zone.  For  example, 
Xi  is  the  MRM  for  the  first  ship,  X2  is  the  MRM  for  the  second  ship,  and  so  on.  The 
variable  y9  is  a  decay  rate  which  is  an  adjustable  value  that  allows  the  returns  to  increase 
or  diminish  for  each  additional  ship  added  to  a  zone  at  a  rate  determined  by  the 
commander.  In  our  case,  each  Xx  is  multiplied  by  the  raw  reward  value  for  a  given  ship  s 
in  location  /  in  the  order  in  which  ships  were  assigned  to  be  scheduled.  This  allows  for 
commanders  to  prioritize  which  ships  may  incur  the  greatest  penalty  within  the 
diminishing  returns  function.  The  changes  in  the  cumulative  effects  of  adding  more 
ships  to  a  given  zone  can  be  represented  by  adjusting  p  as  depicted  in  Figure  8.  In  this 
case,  the  y-axis  represents  the  number  of  ships  worth  of  effectiveness  that  exist  in  a  given 
region  and  the  x-axis  represents  the  actual  number  of  ships  assigned  to  that  region. 


Number  of  Ships  in  Zone  Number  of  Ships  in  Zone 

Figure  8.  Cumulative  Effects  of yO  =  0.28  and p  =  0.68. 


Finally,  an  all-zones  coverage  coefficient,  (p,  is  multiplied  to  the  resultant  reward 
from  each  configuration. 
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2. 


UAV-Based  Rewards  Augmentation 


To  provide  the  ability  to  study  the  effeets  of  augmenting  a  given  platform  with 
UAVs,  an  additional  ship  type  is  added  to  the  RUM  to  allow  for  its  theoretieal  rewards  to 
be  set.  The  same  open  ship  type  may  be  also  used  to  measure  the  effeets  of  other 
advaneements  that  improve  the  effeetiveness  of  a  given  platform  in  performing  MIO. 

D,  SCHEDULE  EXTRACTION 

To  attain  the  end  result  and  promulgate  a  sehedule  for  ships  assigned  to  the  CMF 
eommander,  a  maero  is  produeed  to  extraet  the  individual  daily  eonfigurations  from  a  log 
file  produeed  by  C-RAMS.  These  eonfigurations  are  then  translated  into  fifteen  veetors 
of  ship  names  and  geographie  loeations.  Finally,  the  daily  and  eumulative  reward  values 
are  displayed  in  a  table  in  order  to  provide  data  whieh  may  be  used  to  perform  sensitivity 
analyses  and  measure  the  effeets  of  ehanging  input  parameters. 
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IV.  ANALYSIS 


A,  CASE  STUDY 

In  order  to  establish  a  baseline  set  of  data  from  whieh  analyses  ean  be  made, 
relative  zone  reward,  relative  ship  reward,  ah  zone  eoverage  multiplier,  and  diminishing 
returns  multipliers  are  ehosen.  Ah  rewards  are  seleeted  to  be  uniform  throughout  the 
notional  seheduling  period  and  set  to  the  values  shown  in  Table  1.  In  this  base  ease,  not 
ah  ships  are  assumed  equally  effeetive  in  performing  MSO  in  every  sea  zone.  For 
example,  the  small  size  and  relatively  smaller  radar  and  eommunieations  eapabilities  of  a 
U.S.  Navy  PC  make  it  less  desirable  to  patrol  in  the  Arabian  Sea/Westem  Indian  Oeean 
than  in  the  Arabian  Gulf.  Furthermore,  it  is  assumed  that  a  US  Navy  eruiser,  with  its 
robust  radar  and  eommunieations  capabilities  as  well  as  embarked  LAMPS  assets  would 
be  more  effective  in  general  than  a  U.S.  Navy  frigate  with  no  helicopters.  To  begin  with, 
there  is  no  value  given  to  ship  type  F,  a  U.S.  Navy  Flight  I  DDG  with  UAVs.  The  bold 
italicized  numbers  in  Table  I  represent  the  values  returned  to  the  rewards  subroutine  (for 
example  a  Flight  I  DDG  in  zone  3  would  return  17.6). 


Zone 


Base  Value 

1 

2 

3 

4 

A 

CG/IIADDG 

80 

f7.7 

18.5 

11.8 

32 

B 

FI  DDG 

60 

12 

12 

17.6 

18.4 

C 

US  FFG/COALITION  FFG  NO  HELO 

65 

16.3 

16.3 

16.3 

16.3 

D 

US  FFG/COALITION  FFG  WITH  HELO 

72 

18 

18 

18 

18 

E 

USCGC/PC 

40 

8.8 

11.2 

4 

16 

F 

FI  DDG  W/  UAV 

75 

15.1 

15.1 

21.6 

23.1 

Table  I .  Sample  Default  Reward  Values  from  C-RAMS 
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Next,  the  diminishing  returns  value,  p,  is  selected  for  each  zone,  resulting  in  four 
distinct  decay  curves  which  represent  a  cumulative  value  as  ships  are  added  to  a  given 
sea  zone.  For  example,  in  this  case  five  ships  assigned  to  the  Red  Sea  incur  a  penalty 
which  makes  them  essentially  as  effective  as  four  ships  (as  seen  in  Figure  9). 

Rho  =  0.68  «l  I  >1 


Cumulative 

Effectiveness 

Arabian  I  0  (?) 


Number  of  Ships  in  Zone 

Rho=  0.92  iJ  J  Jj 


Cumulative 

Effectiveness 

AraMnGut(4) 


Number  of  Ships  In  Zone 

Figure  9.  Sample  Diminishing  Returns  Multiplier  Graphs  from  C-RAMS. 

After  building  a  baseline  for  rewards,  a  set  of  scenarios  are  selected,  each  of 
which  may  have  one  to  three  parameters  altered  to  determine  the  scheduling  tool’s 
flexibility  and  sensitivity  to  changes.  Since  one  of  the  major  aims  of  this  study  is  to 
effectively  analyze  the  future  utility  of  employing  UAVs  on  MSO  missions,  four  U.S. 
Navy  Flight  I  DDGs  are  selected  as  the  focus  of  our  analysis.  In  order  to  account  for  all 
four  operational  zones  and  to  initially  eliminate  the  possibility  of  interaction  effects  with 
other  ship  types,  these  ships  were  set  up  in  the  model,  each  with  a  single  different 
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Number  of  Ships  In  Zone 


Number  of  Ships  in  Zone 

Rho  =  1.52  <1  I  >1 


Rho=  0.54  _lJ  J  _lI 


commitment  (such  a  port  visit  or  RAS)  scheduled  as  parameters  on  the  fifteen  day  time 
horizon  and  each  beginning  this  scheduling  period  in  the  Arabian  Sea  (zone  2).  The 
inputs  for  this  scenario  can  be  seen  in  Figure  10,  with  the  green  “0”  days  open  for 
assignment  by  the  C-RAMS  program. 


Symbol  LAB 

OKE 

GON 

STO 

Type 

US  FI  DOG  ▼ 

1  US  FI  DOG  ▼ 

US  FI  DOG  ▼ 

1  US  FI  DOG  ▼ 

Code 

B 

B 

B 

B 

Julian 

1 

GOA^MVIO  ▼  1  GOA^WVIO  ▼ 

GOA^NVIO  ▼  1  GOA^MVIO  ▼  | 

2 

2 

2 

2 

2 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

0 

0 

0 

0 

3 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

0 

0 

0 

~0 

4 

RAS-RS  ▼ 

Open  For  Ass  ▼ 

Open  For  Assi 

Open  For  Assi  ▼ 

11 

~0 

0 

0 

5 

Open  For  Ass  ▼ 

Open  For  Ass 

Open  For  Ass 

Open  For  Ass 

0 

0 

0 

~0 

6 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Assi  ▼ 

Open  For  Assi  ▼ 

0 

0 

0 

0 

Open  For  Ass  ▼ 

RAS-GOA^AS  ▼ 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

0 

12 

0 

0 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

0 

0 

0 

0 

9 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Ass 

0 

~d 

0 

0 

10 

Open  For  Ass 

Open  For  Ass 

Open  For  Ass 

Open  For  Ass 

0 

0 

0 

0 

11 

Open  For  Ass  ▼ 

Open  For  Ass 

Open  For  Ass 

Open  For  Ass 

“5 

0 

0 

12 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

RAS-HOA  ▼ 

Open  For  Ass  ▼ 

0 

0 

13 

0 

13 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Assi 

Open  For  Assi  ▼ 

0 

0 

0 

0 

14 

Open  For  Ass  ▼ 

Open  For  Ass  ▼ 

Open  For  Ass 

Open  For  Ass  ▼ 

■ - ^ 

“B 

0 

0 

15  Open  For  Ass 

Open  For  Ass 

Open  For  Assi  ▼ 

Port-AG  ▼ 

1  0 

0 

0 
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Figure  10.  Initial  Inputs  for  Baseline  Scenario  in  C-RAMS. 

Next,  sixteen  scenarios  are  built  in  C-RAMS  with  modifications  to  various  parameters 
made  as  illustrated  in  Table  2. 
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Scenario  Number  of  All  zones  Number  Relative  Notes 

Ships  coverage  of  UAV  value 
coefficient  UAVs  to 

Helicopter 


1 

4 

1 

0 

N/A 

2 

4 

1.15 

0 

N/A 

3 

4 

1 

0 

N/A 

One  predetermined  commitment  changed  from  scenarios  1  and  2 

4 

4 

1.25 

0 

N/A 

One  predetermined  commitment  changed  from  scenarios  1  and  2 

5 

4 

1 

0 

N/A 

6 

4 

1.25 

0 

N/A 

7 

10 

1.15 

0 

N/A 

8 

10 

1.25 

0 

N/A 

9 

10 

1.25 

1 

0.75 

10 

10 

1.25 

2 

0.75 

11 

10 

1.25 

3 

0.75 

12 

10 

1.25 

4 

0.75 

13 

10 

1.25 

1 

1.25 

14 

10 

1.25 

2 

1.25 

15 

10 

1.25 

3 

1.25 

16 

10 

1.25 

4 

1.25 

Table  2.  Scenario  Characteristics 


B,  SCHEDULING  FOUR  U.S.  NAVY  FLIGHT  I  DDGs 

The  first  six  scenarios  modeled  consist  exclusively  of  the  four  U.S.  Navy  Flight  I 
DDGs.  We  chose  USS  LABOON,  USS  OKANE,  USS  GONZALEZ,  and  USS  STOUT 
as  our  sample  assets.  After  the  first  scenario  is  run,  the  expected  outcome  was  realized, 
with  each  ship  dispersing  to  all  four  zones  in  which  they  had  a  pre-programmed 
commitment  and  then  migrated  to  zones  with  the  two  highest  relative  reward  values  for 
their  ship  type. 

After  scenario  1,  there  first  change  was  to  study  the  effect  of  a  bonus  for  having 
covered  all  four  zones.  With  all  else  the  same  as  the  first  scenario,  scenario  2  had  the 
four  ships  starting  out  as  before,  but  remaining  in  each  of  the  four  zones,  selecting  the 
configuration  that  would  give  them  a  15%  increase  in  aggregate  reward  value  for  an 
additional  seven  days. 
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The  third  scenario  (Table  3)  was  set  to  be  the  same  as  the  first,  but  instead  of 
having  a  different  commitment  in  one  of  each  of  the  zones,  the  second  ship  was  pre¬ 
scheduled  for  a  port  visit  on  the  seventh  day  in  the  Horn  of  Africa  zone.  Since  this  zone 
(along  with  the  Arabian  gulf)  are  the  two  highest  reward  zones  in  this  scenario,  the  ships 
again  ended  up  occupying  these  zones  following  the  first  ship’s  scheduled  RAS  in  the 
Red  Sea  on  day  4. 

In  our  fourth  scenario  (Table  3),  the  same  initial  parameters  from  the  third 
scenario  were  left  in  place,  however  an  all  zones  coverage  bonus  of  25%  was  set.  After 
running  the  program,  each  ship  behaved  as  they  did  in  the  beginning  of  the  first  scenario, 
but  dispersed  to  all  for  zones  when  possible  after  completing  each  preset  assignment  as 
before  as  the  all  zones  coverage  bonus  dominated  the  value  of  two  of  the  ships  occupying 
zones  3  and  4  as  in  the  third  scenario. 

Scenarios  5  and  6  set  began  just  as  the  first,  but  in  each  of  these  cases  the  relative 
reward  for  occupying  zone  2  was  made  to  dominate  all  others  for  days  seven  through 
nine  (Table  3).  As  would  be  expected,  in  the  scenario  in  which  no  multiplier  incentivized 
movement  to  all  four  zones,  all  four  ships  loitered  or  returned  to  zone  two  until  after  day 
9.  For  the  final  five  days,  the  ships  would  be  returned  to  the  same  destinations  as  before, 
with  two  each  in  zones  3  and  4,  or  dispersed  to  all  four  zones  with  an  all  zones  bonus  of 
25%. 

In  order  to  see  the  effects  of  changing  these  various  parameters.  Table  3  depicts 
the  daily  locations  of  LABOON  (LAB),  OKANE  (OKE),  GONZALES  (GON),  and 
STOUT  (STT)  when  in  a  sea  zone  accruing  rewards  for  these  first  six  scenarios,  the 
characteristics  of  which  are  depicted  in  Eigure  10. 
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Scenario  1 


LAB 

LAB 

lAB.OKt 

GOiLSn 

OKE 

OKE 

OKE 

OKE 

OKE 

LAB 

OKE 

GON 

GON 

GON 

GON 

GON 

GON 

GON 

OKE,GON 

OKE, GON 

OKE, GON 

OKE,GON 

OKE,GON 

GON 

STT 

STT 

STT 

STT 

STT 

LAB,SU 

LAB, STT 

LAB, STT 

LAB, STT 

LAB, STT 

LAB, STT 

1  2  3  4  6  6  7  8  9  10  11  12  13  14  15 

DAY 


Scenario  2 


1 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

Zone  2 

LAB.CKt 

GOK.SJJ 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

3 

GON 

GON 

GON 

GON 

GON 

GON 

GON 

GON 

GON 

GON 

GON 

GON 

4 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

LAB 

LAB 

lAB.OKE 

GOK.S77 

Me 

OKE,GON 

OKE,GON 

OKE,GON 

OKE,GON 

OKE,GON 

OKE, GON 

OKE,GON 

OKE,GON 

OKE,GON 

OKE,GON 

0KE,60N 

OKE,GON 

GON 

STT 

STT 

STT 

STT 

STT 

LAB, STT 

M8,STT 

LAB,STT 

MB, STT 

MB, STT 

MB, STT 

1  2  3  4  5  6  7  8  9  10  11  12  13  14  15 


DAY 


Scenario  4 


1 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

LAB 

Zone  2 

lAB.OHl 

G07lt.S77 

GON 

GON 

GON 

GON 

GON 

GON 

GON 

GON 

OKE 

OKE 

OKE 

OKE 

3 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

GON 

GON 

GON 

4 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

1  2  3  4  5  6  7  8  9  10  11  12  13  14  15 


DAY 


Scenario  5 


1 

LAB 

LAB 

Zone  2 

lAB.OKl 

GOKS77 

OKi. 

GOM.S77 

ott 

GOKS77 

ott 

GCKS77 

0*£ 

GBB.S77 

OKE 

GOIIt.S77 

lAB 

GOKS77 

lAB.OKE 

GOKSEE 

3 

LAB,GON 

MB, GOW 

MB 

LAB,GON 

MB,GOAf 

GON 

4 

OKE,STT 

OKE, STT 

OKE,STT 

OKE, STT 

OKE,SU 

1 

2 

3 

4 

5 

6 

7 

8 

DAY 

9 

10 

11 

12 

13 

14 

15 

Scenario  6 

1 

LAB 

LAB 

MB 

MB 

MB 

LAB 

LAB 

LAB 

Zone  2 

lAB.OKE 

GOK.S77 

OKE 

OKE 

OKE 

OKE 

OKE 

GOELSEE 

lAB 

GOELSEE 

lAB.OKE 

GOKSEE 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

OKE 

3 

GON 

GON 

GON 

GON 

GON 

GON 

GON 

4 

STT 

STT 

STT 

STT 

STT 

STT 

STT 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

DAY 


Table  3.  Optimal  Ship  Allocation  for  Scenarios  1  -  6  in  C-RAMS 
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c 


SCHEDULING  TEN  SHIPS 


In  order  to  demonstrate  the  interactive  effects  of  up  to  ten  ships  in  C-RAMS,  the 
remaining  six  ship  columns  were  populated  in  the  input  interface.  In  order  to  measure  the 
effects  on  differences  to  the  schedules  of  the  original  four  DDGs,  the  same  input 
parameters  for  these  remaining  six  vessels  were  constant  through  all  scenarios.  For  this 
set  of  scenarios,  these  new  input  parameters  were  added  to  scenarios  2  and  6  (Table  2), 
two  from  the  original  group  for  which  an  all  zones  coverage  bonus  was  available.  The 
set  of  input  parameters  for  the  seventh  scenario  illustrates  this  as  seen  in  Figure  1 1 . 
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Figure  II.  Initial  Inputs  for  Baseline  Scenario  in  C-RAMS. 

In  the  seventh  scenario  there  is  no  change  from  that  seen  in  the  second.  Since 
there  were  no  increased  rewards  by  day,  nor  significant  penalties  assigned  through  the 
diminishing  returns  function,  the  program  had  no  incentive  to  schedule  unnecessary 
movements  through  transit  zones  which  incur  no  reward  (Table  4). 
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In  the  eighth  scenario  (based  on  scenario  6  in  which  zone  2  was  given  a  higher 
reward  value),  some  of  the  other  assets  remained  in  enough  of  the  other  zones  to  ensure 
the  daily  25%  all  zones  coverage  bonus  was  earned  while  otherwise  scheduling  as  many 
ships  as  possible  in  zone  2  on  the  most  valuable  days.  The  resulting  schedules  for  these 
four  ships  in  these  two  scenarios  are  illustrated  in  Table  4. 
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Table  4.  Optimal  Ship  Allocation  for  Scenarios  7  and  8  in  C-RAMS 


D.  SCHEDULING  FLIGHT  I  DDGs  WITH  UAVs 

To  explore  the  sensitivity  of  the  scheduling  results  to  augmenting  U.S.  Navy 
Flight  I  DDGs  with  UAVs,  eight  scenarios  were  built  and  run  building  off  of  scenario  8 
(Table  2). 

If  we  assume  that  employing  a  UAV  on  a  DDG  is  75%  as  effective  as  employing 
a  LAMPS  helicopter  for  performing  MSO  missions,  we  may  set  a  relative  reward  value 
to  ship  type  F  that  encapsulates  this  change  to  the  capabilities  now  available  to  the  CMF 
Commander.  We  then  modify  scenario  8  to  reflect  this  change  and  run  the  model  four 
times,  one  for  each  additional  augmentation. 

Next,  if  we  assume  employing  a  UAV  increases  a  ship’s  mission  effectiveness, 
we  can  set  an  upper  bound  in  our  scenarios  with  the  value  of  UAVs  at  125%  of  that 
provided  under  normal  circumstances  by  LAMPS  platforms.  Again,  four  scenarios  are 
run,  each  adding  one  UAV  capable  DDG  more  than  the  previous. 
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After  running  these  eight  seenarios,  a  gradual  ehange  in  scheduling  outputs  was 
discovered.  For  the  first  five  of  these  scenarios,  the  actual  schedule  did  not  change, 
however  a  gradual  increase  in  reward  values  for  the  scheduling  period  were  realized.  In 
scenario  14,  however,  when  two  UAV  augmented  ships  are  scheduled,  ship  2  (a  non- 
UAV  asset)  would  migrate  between  zones  1  and  2,  the  two  zones  with  the  lowest  rate  of 
diminishing  returns  per  ship  added.  Finally,  for  the  last  two  scenarios  the  ships  were  set 
to  execute  the  same  schedule  as  resulted  from  scenarios  9,  10,  11,  12,  and  13,  with  the 
least  coverage  being  scheduled  in  zones  with  higher  rates  of  decay  in  the  diminishing 
rewards  function,  leaving  assets  from  the  pool  of  the  other  six  ships  to  cover  those  areas. 
Table  5  illustrates  the  daily  position  of  these  ships  through  the  eight  UAV  augmented 
scenarios. 
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Table  5.  Ship  Allocation  for  Scenarios  9  through  16  from  C-RAMS 


To  demonstrate  the  improved  relative  expected  effectiveness  in  performing  MIO 
by  augmenting  Flight  I  DDGs  with  UAVs,  the  resulting  reward  values  from  all  eight  of 
these  scenarios  were  plotted  to  illustrate  the  percentage  increase  in  UAV  employment 
reward  effects.  As  illustrated  in  Figure  12,  if  our  assumptions  hold  true  and  UAVs  worth 
75%  of  a  helicopter  detachment  are  assigned  to  Flight  I  DDGs,  the  entire  task  force’s 
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effectiveness  is  increased  by  3%.  Conversely,  a  6%  increase  in  effectiveness  is  realized 
throughout  the  scheduling  period  if  the  assumption  that  a  UAV’s  value  is  125%  that  of  a 
helicopter  detachment  for  performing  MSO. 


UAV  Employment  Reward  Effects 


Number  of  Flight  1  DDGswith  UAVs 


Figure  12.  UAV  Employment  Reward  Effects. 


E.  RUN  TIME  AND  PROBLEM  SIZE 

Eor  the  first  six  scenarios  in  which  the  program  had  only  four  ships  to  schedule, 
the  program  generated  between  3500  and  4000  states  and  took  16  seconds  to  find  an 
optimal  solution.  Conversely,  when  the  larger  scenarios  were  run  with  ten  ships,  more 
than  37,000  states  were  generated  and  the  program  took  just  under  six  minutes  to  return 
its  optimal  result.  All  scenarios  were  run  on  a  Pentium  4  with  3.2  GHz  of  processor 
speed  and  2  MB  of  memory.  It  was  observed  that  more  predetermined  ship  commitments 
resulted  in  faster  run  times  as  well  as  shorter  time  periods  between  preset  commitments. 
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At  no  point  was  it  observed  that  run  time  was  affeeted  by  ehanging  any 
parameters  in  the  RUM.  Furthermore,  sinee  the  dynamie  program  only  ereates  feasible 
state  spaees,  attempts  to  assist  the  program  by  populating  the  input  interfaee  with  obvious 
adjaeent  loeations  (zone  2  following  a  RAS  in  zone  2  for  example)  did  nothing  to  reduee 
the  size  of  the  problem  or  run  time. 

While  C-RAMS  is  suffieient  for  ten  ships  on  a  fifteen  day  seheduling  horizon,  the 
addition  of  ships  and  planning  days  would  inerease  the  size  of  the  problem  at  an 
exponential  rate  and  likely  exeeed  the  eapabilities  of  the  eurrent  arehiteeture’s 
implementation  on  eomparable  eomputer  systems.  For  larger  problems,  either  a  maehine 
with  more  eomputational  power  or  a  heuristie  to  more  effieiently  build  state  spaees  and 
solve  configuration  network  would  be  helpful. 
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V.  CONCLUSIONS  AND  RECOMMENDATIONS 


We  have  developed  the  Coalition  Resource  Allocation  for  Maritime  Security  (C- 
RAMS)  decision  support  tool  that  may  easily  be  implemented  and  shared  by  US  and 
coalition  naval  personnel  for  the  scheduling  of  Maritime  Security  Operations  (MSO) 
ships  in  the  FIFTH  FLEET  Area  of  Responsibility.  This  scheduling  tool  incorporates  a 
given  set  of  pre-existing  mission  commitments  as  parameters  and  provides  an  optimum 
employment  strategy  based  on  commander’s  intent  and  priorities.  Programmed  in  Excel 
and  Visual  Basic,  it  may  be  easily  shared  within  the  DoD  or  among  coalition  allies.  The 
output  is  a  schedule  that  is  feasible,  and  compatible  with  existing  reporting  requirements. 

Eor  each  of  the  sixteen  scenarios  we  examined,  the  optimal  solutions  resulted  in 
an  average  of  four  out  of  240  ship-days  being  scheduled  to  be  in  a  sea  zone  in  which  no 
reward  is  accrued.  While  no  baseline  data  exists  from  which  an  improvement  may  be 
measured,  the  optimal  schedules  produced  by  C-RAMS  provide  an  insight  to  how  many 
ship-days  may  currently  be  inefficiently  allocated. 

Given  the  flexibility  of  the  rewards  update  module,  C-RAMS  allows  for  further 
study  in  the  efficacy  of  UAVs  as  an  organic  asset  to  US  Navy  ships  conducting  MSO. 
Eurthermore,  C-RAMS  may  be  used  to  make  recommendations  for  the  procurement  and 
deployment  of  UAVs  based  on  the  added  capabilities  of  a  given  system  to  US  assets 
assigned  to  the  Combined  Maritime  Eorce.  Given  the  demonstrable  effects  in  our  of 
scenarios  of  increasing  overall  presence  rewards  by  3  to  19  percent  with  the  addition  of 
UAVs,  it  is  recommended  that  a  larger  set  of  scenarios  is  run  within  a  larger  study  of 
maritime  UAV  employment  strategies.  Eurthermore,  the  results  from  the  scenarios 
examined  in  this  thesis  included  the  entire  set  of  ships  available  to  the  CME  Commander, 
thereby  including  interaction  effects  between  ships.  Eor  non-coalition  based  scheduling 
or  UAV  research,  it  is  recommended  that  scenarios  are  run  that  include  only  U.S.  Navy 
platforms  for  which  UAV  employment  is  being  considered. 
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The  rewards  used  in  the  scenarios  considered  in  this  study  were  based  on 
perspectives  shared  by  U.S.  Navy  Surface  Warfare  Officers  and  the  author’s  experience. 
Future  studies  which  utilize  C-RAMS  should  include  a  robust  analysis  of  ship  capabilities 
and  the  effects  of  interactions  between  ships  in  a  given  region.  While  the  Reward  Update 
Module  is  flexible  enough  to  allow  a  wide  range  of  reward  values,  it  is  designed  to 
provide  reasonable  data  for  studying  the  scheduling  tool,  not  a  proven  real-world 
database  upon  which  operational  decisions  can  be  made. 
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